목차
Abstract
“
There has recently been widespread discussion of whether large language models might be sentient . Should we take this idea seriously? I will break down the strongest reasons for and against. Given mainstream assumptions in the science of consciousness, there are significant obstacles to consciousness in current models: for example, their lack of recurrent processing, a global workspace, and unified agency. At the same time, it is quite possible that these obstacles will be overcome in the next decade or so. I conclude that while it is somewhat unlikely that current large language models are conscious, we should take seriously the possibility that successors to large language models may be conscious in the not-too-distant future.
목차 관련 글 All animals are conscious: Shifting the null hypothesis in consciousness science “Rather than asking the distribution question, we should shift to the dimensions question: How are animals consc…” Large Causal Models from Large Language Models “We introduce a new paradigm for building large causal models (LCMs) that exploits the enormous potential latent…” 의식에 관한 케임브리지 선언 “Convergent evidence indicates that non-human animals have the neuroanatomical, neurochemical, and neurophysiolo…” Large language models are human-level prompt engineers “APE가 생성한 프롬프트: "You will be asked a series of questions.” The Super Weight in Large Language Models “Recent works have shown a surprising result: a small fraction of Large Language Model (LLM) parameter outliers …” Personalization of Large Language Models: A Survey “Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of…” Large Language Models are zero-shot reasoners “Pre-trained Large Language Modell (LLMs) are widely used in many sub-fields of natural language processing (NLP…” On the Effectiveness of Large Language Models in Writing Alloy Formulas “One, we employ LLMs to write complete Alloy formulas from given natural language descriptions (in English).” A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions “The emergence of large language models (LLMs) has marked a significant breakthrough in natural language process…” A comprehensive taxonomy of hallucinations in Large Language Models “Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucin…” The evolution of language faculty: Clarifications and implications “We conclude that progress in understanding the evolution of language will require much more empirical research,…” Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation “Large language models are rapidly transforming social science research by enabling the automation of labor-inte…” 쾌고감수성 관련 절: [[Predictive brain hypothesis|예측하는 뇌 가설]] 관점에서의 설명 What do Large Language Models Say About Animals? “Technical evaluations have addressed a variety of potential harms from large language models (LLMs) towards hum…” iText2KG: Incremental knowledge graphs construction using large language models “Current research leverages large language models' capabilities, such as zero- or few-shot learning.” Language Models Know More Than They Show: Exploring Hallucinations From the Model's Viewpoint “Large language models (LLMs) often produce errors, including factual inaccuracies, biases, and reasoning failur…” The Nature of the Language Faculty and its Implications for Evolution of Language “We show that recursion, though absent from other animals' communications systems, is found in visual cognition,…” Siren's song in the AI ocean: A survey on hallucination in large language models “While large language models (LLMs) have demonstrated remarkable capabilities across a range of downstream tasks…” Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models “We study how to apply large language models to write grounded and organized long-form articles from scratch, wi…” On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? “The past 3 years of work in NLP have been characterized by the development and deployment of ever larger langua…”